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SECTION  1  -  INTRODUCTION 


Consider  a  simple  production  process  which  is  assumed  always  to  be 
in  one  of  only  two  states,  a  good  state  and  a  bad  state.  Specifically, 
production  begins  in  the  good  state  and  while  there  a  chance  event 
occurs  before  each  item  is  produced  so  that  the  probability  of  remaining 
in  the  good  state  is  1  -  n  and  the  probability  of  a  transition  to  the 
bad  state  is  rr  .  Once  in  the  bad  state,  the  process  remains  there  until 
trouble  is  removed. 

Associated  with  each  item  produced  is  a  measurable  characteristic 
or  quality,  denoted  Y,  assumed  to  be  a  random  variable  with  a  distri¬ 
bution  depending  on  the  unknown  state  of  the  machine.  Let  Pq(’) 
p^(  • )  be  the  density  function  for  quality  given  that  the  machine  is  in 
the  good  and  bad  states,  respectively. 

A  statistical  control  rule  is  a  rule  which  specifies  when  the  sys¬ 
tem  is  to  be  brought  from  production  to  repair,  which  has  the  effect  of 
placing  the  process  in  the  good  state.  Other  than  immediately  after 
repair,  the  true  process  state  is  assumed  unknown  at  all  times.  Hence 
a  control  rule  must  be  based  on  the  quality  history  of  produced  items. 
This  history  is  adequately  summarized  in  the  posterior  probability  given 
the  quality  history  that  the  next  item  will  come  from  a  machine  in  the 
bad  state.  This  probability  at  time  t  is  denoted  X  ,  Costs  are 
associated  with  repairing  the  process  and  with  the  quality  of  each  item 
produced,  and  the  objective  is  to  minimize  the  average  cost  per  unit 
time . 
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This  paper  studies  the  100^  inspection  case  where  sampling  is  by 
attributes;  each  item  is  dichotomized  as  of  good  or  defective  quality. 

A  numerically  feasible  method  is  given  for  calculating  the  operating 
characteristics  of  a  rule  as  a  function  of  the  system  parameters  and  the 
critical  value  |*  whicn  the  rule  uses.  The  operating  characteristics 
which  may  be  computed  include  the  expected  time  between  repairs,  the 
variance  of  the  time  between  repairs,  the  overall  proportion  of  defective 
items  produced  and  the  fraction  of  repairs  made  to  systems  still  in  the 
good  state.  The  computational  method  given  may  be  used  for  the  case 
where  quality  is  any  discrete  random  variable. 

The  validity  of  the  computational  method  is  checked  in  two  ways. 

First  some  inequalities  which  the  optimal  solution  must  satisfy  are 
developed  and  conipared  with  the  computed  answer.  Second,  the  discounted 
cost  problem  is  explored  through  dynamic  programming,  and  the  answers 
computed  using  this  method  are  compared  with  the  previously  computed 
answers . 

Next  some  examples  of  the  wide  variety  of  problems  which  may  be 
attacked  through  the  use  of  tables  of  operating  characteristics  are  given. 

Lastly  the  model  is  checked  for  its  sensitivity  to  proper  choice 
of  system  parameters.  The  Girshick  and  Rubin  equations  are  used  to  com¬ 
pute  the  operating  characteristics  in  the  situation  where  incorrect 
parameters  (transition  probability,  etc.)  are  used  to  compute  the 
posterior  probabilities  which  the  rule  uses  for  its  decision 

making. 
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SECTION  2  -  A  MATRIX  FORMULATION 


This  section  develops  the  matrix  formulation  of  the  problem  which 
underlies  the  computational  scheme  proposed.  The  fact  that  the  sequence 
t  =  0,  1,  2,  • * •  1  of  posterior  probabilities  forms  a  discrete 
parameter  Markov  chain  with  a  denumerable  state  space  is  of  fundamental 
importance.  The  computational  method  revolves  about  the  matrix  of 
transition  probabilities  of  this  chain. 

Let  the  good  system  state  be  denoted  by  0  and  the  bad  state  by 
1  and  let  the  state  of  the  system  at  time  t  be  denoted  0^.  It  is 
assumed  that  if  the  machine  is  left  undisturbed,  these  states 
(0^,  t  =  0,  1,  2,  •  •  •  ]  form  a  Markov  chain  with  transition 
probabilities 


( — 1 

=  0] 

-  1  -  Pr[e^,^  = 

=  o|©._ 

=  0] 

l|6t 

=  1] 

=  1  -  = 

'  OlSt 

=  1] 

Rather  than  restricting  the  development  to  the  Bernoulli  random 
variables  of  attributes  inspection  it  is  no  more  difficult  to  allow  the 
measurable  quality  characteristic  to  be  any  random  variable  which  takes 
on  only  a  finite  number  of  possible  values.  Hence,  for  each  0e(O,  1] 
let  p(',  0)  be  a  probabilitjf’  distribution  on  the  elements  y  in  a 
finite  set  That  is  for  every  0e{O,  1],  Y,  viYf  @)  =  1  and  for 


all  yeX,  p(y..  0)  >  0. 

Let  [Yq,  Y^,  Y^,  •  •  •  ]  be  a  s 

conditional  distribution  given 


equence  of  random  variables  whose 
©1,  0^,  • • '  1  is  as  independent 
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random  variables  with  distributed  according  to  p(  •  ^  ®t^  ' 

sequence  '^2*  '  *  '  ^  represents  the  measurements  taken  on  the 

items  the  machine  has  produced. 

After  each  item  is  produced  there  is  the  option  of  continuing  pro¬ 
duction  undisturbed  or  repairing  the  machine.  A  repaired  machine  is  in 
the  bad  state  with  probability  x°  which  is  usually  assumed  to  be  zero. 

For  each  yeY  let  C(y)  be  the  cost  incurred  by  producing  an  item 
of  quality  y  and  let  be  the  co^t  of  repairing  a  machine  which  is 

in  state  Q  for  1). 

The  parameters  introduced  so  far  serve  to  specify  the  model  and  are 
assumed  known. 

If  at  any  time  that  the  machine  is  in  production  it  were  known 

exactly  which  state  the  machine  is  in  one  would  be  able  to  make  the 

proper  decision  whether  or  not  to  repair.  But  the  true  state  of  the 

system  is  unknown,  and  thus  the  only  relevant  information  obtainable 

from  the  observations  at  time  t  is  the  posterior  probability  X  that 

1./ 

the  machine  will  be  in  the  bad  state  for  the  production  of  the  next 
item  assuming  no  repair  is  made.  Girshick  and  Rubin  [9]  and  L.  Breiman 
[6]  show  that  any  decision  rule  of  interest  may  be  specified  by  giving 
a  critical  value  l]  with  the  interpretation  that  the  machine  is 

repaired  at  time  t  if  and  only  if  ^ 

Thus  the  sequence  ^2'  '*•  1  is  of  importance  and  it  is 

desirable  to  formalize  its  structure.  Let  IZT  be  the  unit  interval 
[0,  1]  and  generically  let  x  be  an  element  of  IZr  .  For  each  ytY, 
two  operators  are  defined  on  31  into  31  by: 


k 


A^x  =  xp(y,  l)/[xp(y,  l)  +  (l  -  x)p(y,  O)  ] 


(2.1) 


and 


T  X  =  Ax  +  (l  -  Ax)tt 

y  y  y 


(2.2) 


The  first  operator  is  an  application  of  Baye ' s  formula.  If  x  is 
a  prior  probability  that  the  machine  is  in  the  bad  state  and  Y  =  y  is 
produced  then  the  posterior  probability  that  the  item  came  from  a  machine 
in  the  bad  state  is  posterior  probability  that  the  next  item 

will  come  from  a  machine  in  rhe  bad  state  is  T  x. 

y 

For  any  critical  value  define  the  transformation  from 

into  31  by: 


X  =  / 

y  ' 


T  X 

y 


T  X 

y 


if  X  <  I* 

if  X  > 


(2.3) 


Let  =  X  which  assumes  the  system  starts  in  the  repaired  state 


and  then  define  the  sequence 


]  recursively  by 


\+l 


(2.4) 


THEOREM  2.1 


If  Xq  =  X  and 


sequence  t  =  0,  1,  2, 


T"’.  X.  for  t  =  0.  1,  2,  •  '  •  then  the 
t 

••  ]  forms  a  stationary  (time  homogenous) 


Markov  chain. 
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PROOF : 


Suppose  X  =  X  for  s  =  0,  1,  2,  ...  ,  t  and  let 
s  s 

=  (y:  =  T]]  for  any  R . 

Then 


Pr[Xt^l  =  rIx^  =  X  ,  ...  ,  X^  =  =  Pr[Y^€S^|X^  =  x°,  . . .  ,  X^  =  x^ ] 


0 


t^^T)  '“0 


=  X  Y,  p(y>  1)  +  (1  -  X  )  X  p(y^  o) 


=  Pr[x^^i  =  r|x^  =  xj 


Q.E.D. 


Since  the  space  X  was  assumed  finite,  there  are  only  a  finite 
number  of  possible  values  for  the  random  variable  X^  for  any  given  t. 
The  union  over  t  =  0,  1,  2,  ‘ *  of  the  sers  of  possible  values  is  at 
most  countable  and  this  set,  denoted  by  J,  is  the  state  space  for  the 
Markov  chain. 

The  period  immediately  following  one  repair  to  and  including  the 
next  repair  will  be  referred  to  as  a  cycle.  The  next  theorem  states 
that  for  the  purpose  at  hand  the  process  may  be  studied  completely  by 
concentrating  on  the  first  cycle  only. 

THEOREM  2 . 2 

"t  h 

Let  be  the  length  of  and  the  total  cost  of  the  k 

cycle.  If  E[N^]  <  +  OT  then  with  probability  one 
is. 

limJ(W^  +  •••  +  Wj^)/(N^  +  •••  +  Nj^)]  =  E[W^]/E[N^] 


PROOF : 


Wp,  .  .  .  are  independent,  identically  distributed  random  vari¬ 
ables  with  E[ |R^  |]  <  +  CO  and  similarly  for  N^,  •  *  *  .  The  theorem 

follows  immediately  from  the  law  of  large  numbers.  Q.E.D. 

It  is  easiest  to  study  the  first  cycle  by  considering  the  Markov 
chain  to  be  absorbed  when  X  >  !*•  Let  R  be  the  repair  region  defined 

U 

by  R  =  Jn[^*,  l],  and  let  H  be  the  transition  probability  matrix 
corresponding  to  this  absorbing  chain.  The  i,  entry  of  H  is 

corresponding  to  a  transition  from  x^eJ  to  x'^eJ. 

H  is  symbolically  partitioned  into 


H  --- 


H 


11 


H 


12 


0 


where  H^p  has  domain  J  -  R  X  J  -  R,  Hp^  has  domain  J  -  R  X  R  and 

I  is  the  R  X  R  identity.  The  partition  is  symbolic  in  the  sense  that 

each  submatrix  is  usually  infinite  dimensional. 

For  the  absorbing  Markov  chain  with  Xq  =  x°  let  H'’  =  be  the 

J 

row  vector  with  equal  to  the  expected  number  of  X^  -  x"^  for 

x'^^R.  Let  N  be  the  cycle  length: 


N  =  inf  (t:  X^eR] 


and  let  A  =  (A.)  be  the  row  vector  with 
J 


=  Pr[X^  =  x-^IXq  =  x°] 


for 


eR. 
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For  a  finite  Markov  chain  the  following  theorem  is  well  known. 


THEOREM  2  0- 

Let  A  be  the  row  vector  (l,  0,  0,  •*•)  and  1  the  coliomn 
vector  consisting  entirely  of  ones.  For  the  absorbing  Markov  chain 
described  above,  ^  is  the  unique  non-negative  minimal  solution  to 

ilf(l  -  =  A  (2.5) 


and  further 


A  . 

(2.6) 

E[N]  =  tl 

(2.7) 

For  a  Markov  chain  with  denumerable  state  space  the  development 
leading  to  the  proof  of  this  theorem  may  be  found  in  Kemeny,  Snell  and 
Knapp  [12]  in  the  chapter  on  transient  chains.  Although  not  a  rigorous 
proof,  an  intuitive  justification  of  Equation  2.5  is  easily  made.  For 
every  column  other  than  the  first,  the  equation  may  b--^  written 

.  =  y  i|f  .11  ,  .  :  x^^R  and  /  x° 

x'^j/R 

In  words,  the  expected  number  of  times  the  process  is  in  state  x^ 

is  equal  to  the  expected  number  of  times  the  process  is  in  x"^  leading 
to  x^  weighted  by  the  probability  of  such  a  transition,  and  this  is 
summed  for  all  x'^^R.  The  first  column  of  the  Equation  2.5  is  =  1 
which  states  only  that  a  repair  occurs  once  per  cycle. 
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This  theorem  leads  to  the  computation  of  the  average  cost  per  per^^^od 
for  any  critical  value  Let  W  be  the  total  cost  of  the  first  cycle 

and  y  the  average  cost  per  period. 

7  -  E[W]/E[N]  (2.8) 

V/  has  two  components  of  cost:  the  cost  due  to  the  quality  of  items 

produced  and  W  ,  the  repair  cost.  For  X  =  the  expected  cost  of 

the  next  item  is 

E  [C(Y)]  =  x^  X  C(y)p(y,  l)  +  (l  -  x^)  X  C(y)p(y,  O). 

X  yeY  yel 

E  .[C(y)]  denotes  the  expectation  of  C(Y)  where  Y  .s  distributed 

X 

according  to  p( * ,  0)  and  0  is  zero  with  probability  x  and  one 
with  probability  1  -  x^.  Thus 

E[W^]  =  X  JC(Y)]  (2.10) 

xVr  ^ 

For  =  x'^eR,  the  probability  that  repair  will  be  made  to  t.  bad 

machine  is  x"^ .  Hence 

ECW^]  =  X  (2.11) 

x'^gR 

and  E[W]  =  E[W^]  +  . 

Thus  by  solving  the  infinite  set  of  linear  equations  '|f(l  -  ^ 

which  depend  upon  a  particular  choice  of  a  critical  value  and  then 

computing  A  =  E[N]  =  \;fl  one  may  compute  the  average  cost 

per  period  y  =  E[W]/e[M]  corresponding  to  the  use  of  as  a  critical 
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value.  By  doing  this  for  several 


in  a  trial  and  error  manner  one 


may  compute  the  minimum  cost  policy. 

It  should  be  noticed  that  the  cost  information  enters  the  computa¬ 
tions  at  a  late  stage.  The  major  computing  effort  lies  in  computing  the 
\1/  and  A  vectors  and  it  is  only  after  these  are  computed  that  cost 
factors  enter.  Therefore  as  a  solution  to  the  problem  it  is  proposed 
to  table 


a. 


b . 


m 

o 


I  x\. 

X  (l  - 


=  The  number  of  periods  per  cycle  the 
machine  is  in  the  bad  state.  (2.12) 

=  The  number  of  periods  per  cycle  the 
machine  is  in  the  good  state.  (2.13) 


c.  m  +  m.  =  E[N] 

o  1 

d.  Y  •■=  y  x'^A. 

^  j 

x^eR 


=  The  expected  cycle  length.  (2.14) 

=  The  expected  fraction  of  repairs  made 
to  bad  machines.  (2.15) 


e . 


r  =  1  - 
o 


1 


=  The  expected  fraction  of  repairs  made 
to  good  machines.  (2.l6) 


as  a  function  of  the  system  parameters  and  the  critical  value  In 

this  notation  one  has: 

E[W^]  =  X  C(y)p(y,  O)  +  m^^  ^  C(y)p(y,  l) 

y  y 

E[W2]  r^Ko  - 


is  a 


Some  other  easily  computed  results  are  of  interest.  If 
numerically  valued  random  variable  the  average  outgoing  quality  level  is 

trfio  ^  "^1  Z yp(y>  i)]/[m^  +  m^] 

y  y 

The  repairs  per  period  is  l/(m^  +  .  The  second  moment  of  the  cycle 

length  may  be  computed  by  solving 

(I  -  H^^)cp  = 

for  the  column  vector  cp  and  then 

E[N^]  -  X  Vi  * 

These  results  may  be  used  for  comparison  against  actual  values  encoun¬ 
tered  in  an  application.  Cycle  lengths  or  quality  levels  differing 
significantly  from  predicted  values  would  indicate  an  erroneous  choice 
of  parameters. 

The  results  presented  so  far  may  be  generalized,  at  least  partially, 
to  the  case  of  a  machine  with  more  than  two  underlying  states,  say  a 
machine  witli  a  mediocre  state  as  well  as  a  bad  and  a  good  one.  Con- 
ceptially  the  results  still  hold  but  the  posterior  probability  distribu¬ 
tion  lEI  which  tracks  the  process  must  now  be  multidimensional.  This 

U 

leads  to  such  difficulties  both  in  computing  and  implementing  the  policy 
so  as  to  render  this  generalization  of  little  interest. 
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SECTION  3  --  A  NUMERICAL  SOLUTION 


This  section  discusses  a  numerical  so]-ution  to  the  set  of  linear 
equations 


'J;(I  -  =  A 

or 

\lr .  =  y  'If.Tl..  for  x'^/R  and  x'^  4 
J  ^  1  ij 

xVr 

Usually  a  reduction  of  this  infinite  set  of  equations  to  a  finite 
set  is  the  first  step  in  any  solution.  One  method  is  to  consider  only 
those  states  that  the  t  =  0,  1,  }  process  can  reach  in  m 

steps,  or  nearly  equivalently,  to  truncate  the  quality  history  and  not 
use  the  quality  of  items  produced  more  than  m  periods  ago  in  computing 
the  posterior  probabilities.  For  m  sufficiently  large  the  ensuing 
finite  set  of  equations  will  closely  approximate  the  infinite  set. 
Unfortunately  the  number  of  possible  states  reached  in  m  steps  of  the 
(  X^,  t  =  0,  1,  • • •  )  process  is  astronomically  large,  even  for 
moderate  m.  It  has  an  order  of  magnitude  of  the  cardinality  of  Y 
raised  to  the  m  -  1  power. 

But  consider  the  implementation  of  a  policy  of  the  optimal  form. 

A  machine  operator  repairs  his  machine  and  starts  operation  with  a 
probability  on  the  bad  state  of  zero.  After  inspecting  each  item  pro¬ 
duced  he  updates  his  posterior  probability.  When  it  reaches  a  cri+ ical 
value,  say  .60  chance  that  the  machine  is  in  the  bad  state,  he  repairs 
the  machine  and  begins  the  cycle  anew.  It  would  not  seem  objectionable 
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if  this  machinist  computed  these  probabilities  only  to  the  nearest  .01 
decimal  place.  But  this  automatically  reduces  the  problem  to  a  finite 
number,  at  most  101,  of  posterior  probability  states-  This  simple  idea 
is  the  keystone  in  the  proposed  numerical  solution. 

As  a  practical  matter  it  seems  best  not  to  have  a  constant  mesh 

size  such  as  .01  but  to  have  the  mesh  size  vary  so  as  to  be  sufficiently 

sm.all  to  be  able  to  handle  the  smallest  change  in  posterior  probability 

encountered.  For  example,  if  =  x  one  would  want  the  mesh  size  at 

X  to  be  at  least  as  small  as  min  |x  -  t  x|.  Unfortunately,  this  too 

\r  X 

may  be  difficult  to  achieve  entirely  but  it  serves  as  a  useful  target. 

The  algorithm  for  approximating  the  transition  probability  matrix 
will  be  presented  for  the  case  of  inspection  by  attributes  where  item 
quality  is  a  Bernoulli  random  variable.  Let  =  0  if  the  t"*"^  item 

is  good  and  Y_^  =  1  if  it  is  defective.  For  this  special  case  let  p^ 
be  the  fraction  of  good  items  produced  when  the  machine  is  operating 
correctly  and  let  p^  be  this  fraction  when  the  m.achine  is  in  the  bad 
state . 


P^)  =  p(0,  0)  for  0e(O,  1]  . 

The  algorithm  which  com:putes  the  approximating  transition  proba¬ 
bility  matrix  is  described  in  the  Appendix.  Table  shows  such  a 

transition  probability  matrix,  computed  on  a  Burrough ' s  B5000  machine. 
The  states  listed  are  possible  values  for  the  posterior  probabilities 
used  in  controlling  the  process.  The  algorithm  generating  this  matrix 
has  two  distinct  phases.  In  the  first,  a  finite  number  of  these  states 
are  generated,  and  in  the  second  the  transitions  among  these  states  are 
filled  in. 
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A 

Once  the  finite  matrix,  denoted  H,  which  approximates  the  infinite 
matrix  H  has  been  computed  one  proceeds  to  compute  operating  charac¬ 
teristics  as  a  function  of  a  critical  value  ^ .  it  has  been  shown 
earlier  that  the  major  computing  effort  lies  in  solving  the  equations 


I  -  H-  ’')  =  A  ,  (5,1) 

Ap  * 

where  H  is  the  submatrix  of  H  consisting  of  states  with  values 
less  than 

To  do  this  in  the  most  efficient  manner  it  is  best  to  set  up  the 
largest  possible  set  of  transposed  equations. 


(I 


- 


(5-2) 


and  then,  using  the  common  Gaussian  elimination  technique,  to  solve  sub¬ 
sets  of  these  equations  for  increasing  i*,  in  an  increasing  manner. 
Besides  allowing  this  overlapping  of  effort,  the  Gaussian  elimination 
technique  recognizes  the  many  zero  coefficie  ,s  n  the  equations, 
enabling  a  faster,  more  accurate  solution.  The  rriodified  Gaussian  elimi¬ 
nation  procedure  used  is  also  presented  in  the  Appendix. 

A  sample  of  the  results  of  the  program  is  given  in  Table  II.  The 
process  parameters  are  listed  at  the  top  of  the  page.  The  operating 
characteristics  corresponding  to  each  choice  of  critical  value  appear 
below  this.  The  entire  calculations  took  6  seconds  of  B5OOO  computer 
t  ime , 
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1  1 
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0.972 

43 

0,674 

0,028 

12 

0.095 

1  3 

0.097 

0.972 

4  3 

0.674 

0.028 

1  3 

0.097 

14 

C  .  102 

0.972 

43 

0.674 

0.028 

0,102 

1  4 

0,102 

0.971 

44 

0.713 

0.029 

15 

0.107 

15 

0.107 

0,970 

44 

0.713 

0.0  30 

16 

C  .  1  1  3 

15 

0 . 1  U  7 

0.969 

44 

0.713 

0.031 

17 

0.114 

1  6 

0.113 

0.968 

44 

0,713 

O.C32 

16 

0.117 

1  7 

C  .  1  1  4 

0.968 

45 

0.749 

0,032 

19 

0.119 

16 

0.117 

0.967 

45 

0.749 

0.033 

20 

0.122 

19 

0,119 

0,967 

45 

0.749 

0.033 

21 

0.126 

20 

0.122 

0.966 

45 

0,749 

0.034 

22 

C.  131 

2  1 

0,126 

0.965 

45 

0.749 

0,035 

23 

0.136 

22 

0.131 

0.964 

45 

0,749 

0,036 

24 

0.143 

23 

0.136 

0.963 

4  6 

0.782 

0,037 

25 

0,150 

24 

0.143 

0,961 

46 

0.782 

0.039 

26 

0.159 

25 

0.150 

0.960 

46 

0.782 

0.040 

27 

0.170 

26 

0,159 

0.958 

47 

0.812 

0.042 

26 

0.183 

27 

0.170 

0.955 

47 

0.812 

0,045 

29 

0.196 

26 

0,163 

0.9';2 

48 

0.8  39 

0.048 

30 

0.216 

29 

0.198 

0.949 

48 

0.839 

0,051 

3  1 

0.236 

30 

0.216 

0,945 

49 

0,863 

0.055 

32 

0,259 

31 

0.236 

0.941 

5C 

0,884 

0.059 

33 

0,265 

32 

0 .259 

0.936 

50 

0.884 

0,064 

34 

0.315 

33 

0 .265 

0.930 

51 

0.902 

0,070 

35 

0.346 

34 

0,315 

0.924 

52 

0.9  18 

0.076 

36 

0.383 

35 

0,348 

0.917 

53 

0.9  31 

0,083 

37 

0.422 

36 

0.363 

0.9  10 

54 

0.942 

0,090 

38 

0.462 

37 

0.422 

0,902 

54 

0.942 

0.098 

39 

0.504 

36 

0,46? 

0.894 

55 

0.952 

0.106 

40 

0.547 

39 

0,504 

0.886 

56 

0.960 

0.114 

41 

0.590 

40 

0.547 

0.878 

57 

0.967 

0.122 

42 

0.633 

4  1 

0.590 

0,870 

57 

0.967 

0,130 

43 

0,674 

42 

0.633 

0.862 

57 

0.967 

0,138 

44 

0,713 

43 

0,674 

0.855 

57 

0,967 

0.145 

45 

0.749 

44 

0.713 

0.848 

57 

0.967 

0,152 

0  .'it  r 


Table  I  (Continued  on  next  page) 
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0 .995 

0 . 1  e  1 
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0  .  <*  1  a 

5  1 

C  .90? 

o.aic 

999 

0.996 

0.164 

53 

C.9J1 

0  .  9  1  H 

0  .  e  1  3 

999 

0.996 

0.167 

5^ 

Q.'.iiX 

5  i 

r. .  9  j  1 

0  .  fi  1 1 

999 

0.997 

0.169 

55 

0.95? 

5 '4 

0 , 9  .4  ? 

0 .  ao9 

999 

0.99tf 

0.191 

56 

U  .  960 

5b 

0.95? 

0 .  a  0  e 

999 

0 .996 

0.192 

57 

0.96/ 

5  0 

c  .9(,n 

0 .  a06 

999 

0 . 9  Vd 

0.194 

Table  I  An  approximate  transition  probability  matrix  is  given  here  for 
the  case  where  a  process  in  the  good  state  has  a  probability  of  PI  =  .02 
of  moving  to  the  bad  state  for  the  production  of  the  next  item.  PO  -  .99 
and  PI  =  .80  are  the  fraction  of  good  items  produced  when  the  ma.chine 
is  in  the  good  and  bad  states  respectively.  The  table  has  the  following 
interpretation.  From  any  state  such  as  state  number  25,  x  =  .I50  the 
posterior  probability  t  =  0,  1,  }  can  go  to  one  of  two  other 

states.  If  a  good  item  is  observed,  which  for  =  .15O  occurs  with 

probability  .961,  the  process  moves  to  state  number  24  with  X^+2_  =  .145. 
If  a  defective  item  is  observed  then  X^_^j  -  .782. 

ASYP  =  .104  is  a  value  about  which  the  states  tend  to  cluster.  An 
approximation  is  made  here  by  grouping  all  states  within  EPSL  =  .007 
of  ASYP  into  two  classes  and  assigning  a  common  value  to  each  class. 

A  second  approximation  occurs  when  a  "TO  STATE"  cannot  be  found  exactly 
among  the  finite  number  of  states  listed.  Such  a  "TO  STATE"  is  assigned 
to  its  best  approximation  and  MAX.  APPROX.  =  .0201  measures  this 
approximation. 
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0.0272 
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0.697 
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0.55 
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35,37 
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0.0277 

0.291 
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0 .02564 

0.60 

39 . 3P 

3  5.66 

3.72 

0.0279 

0 .265 
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0 ,02540 
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0,0205 

0.274 

0.726 

0 .0249  3 
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42,15 

37.64 

4 .50 

0  .  C  30  3 

0.246 

0.754 

0.02373 

0,7b 

55.67 

46.96 

8.91 

0.C403 
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0.9  36 

0.01790 
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56.31 

4  7 . 2  3 

9.08 

0.0406 

0.057 

0.943 

0.01776 

o.as 

57.05 

4  7.65 

9.40 

0.0413 
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0.951 
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0,90 

57  ,  78 

4  e  .  0  1 

9.78 

0 . 042  1 

0.042 

0.956 

0.01731 

0,95 

59 .66 

46.67 

10.99 
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0.029 

0.97  1 

0.01676 

Table  II  For  the  system  whose  parameters  are  listed  in  the  heading, 
this  table  gives  the  operating  characteristics  of  rules  defined  by 
a  critical  value.  For  example,  if  the  rule  "Repair  at  time  t  if 
and  oixly  if  X|.  >  .65"  is  used  then  the  expected  cycle  length  or 
number  of  periods  between  repairs  is  40.11.  For  56.20  of  these  periods 
the  process  will  be  in  the  good  state;  for  5*91j  the  bad.  The  overall 
fraction  of  defective  items  produced  will  be  .O285.  The  fraction  of 
machines  sent  to  repair  which  were  actually  still  in  the  good  state  is 
.274.  The  remaining  fraction  represents  bad  machines.  The  last 
column  is  the  reciprocal  of  the  cycle  length. 
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SECTION  4  -  SOME  EXAMPLES 


Two  examples  of  the  use  of  these  tables  are  given.  The  first  is  an 
illustration  of  the  simplest  type  of  process  for  which  the  tables  are 
useful;  the  second^  the  most  complex. 

B^xample  I 

Suppose  the  probability  that  the  process  moves  from  the  good  slate 
to  the  bad  state  is  :t  =  .  02 .  Let  Pq  =  *99  and 

fraction  of  good  items  produced  when  the  system  is  in  the  good  and  bad 
state,  respectively.  Each  defective  item  produced  costs  c  =  .6o  units. 
A  good  item  has  zero  cost.  Repair  is  instantaneous  and  costs  x . 00 
unit,  regardless  of  from  which  state  repair  was  made. 

For  each  critical  value,  the  cost  per  period  must  be  computed. 

That  critical  value  having  the  lowest  cost  then  specifics  tlie  optimal 
policy.  For  this  simple  example  the  average  cost  per  period  is  given 
by 

c  X  (Fraction  of  Defective  Items]  +  1  x  (Repairs  Per  Period) 

The  fraction  of  defective  items  and  the  repairs  per  period  are  obtained 
from  Table  II. 

This  computation  yields  Table  III  below. 
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Critical 

Value 


0.  10 
0.15 
0.20 
0.25 
0.30 
0.35 

O.UO 

O.U5 

0.50 

0-55 

O.C  0 

0.65 

0.70 

0.75 

0.80 

0.85 

0.90 

0.95 

Table  III  This  table  lists 


Expected 
Cost /Period 

0.0933^ 

O.OU287 

0.01+287 

O.Oi+2o7 

0.01+287 

O.OI+267 

0 . 01+267 
0,01+250 
0.04250 

0.04225 
0.04216 
0.04205 
C.OI4  191 
0.04208 
0,04214 

0.04231 

0.04259 

0.04376 

the  expected  cost  per  period 


for  each  choice  of  crit±cal  value  for  the  problem 


given  as  Example  1. 


The  minimum  cost  occurs  at  an  optimal  critical  value  of  ^*  =  -70 
and  has  a  value  of  .04191  units  per  item  produced.  The  cost  '^urve  is 
relatively  flat.  At  a  critical  value  of  .60  tie  cost  is  .04216  and 
at  .80  the  cost  if  .04214,  This  flatness  justifies  computing  the 
operating  characteristics  for  critical  values  in  steps  as  wide  apart  as 

.05. 

Referring  again  to  Table  II  one  sees  that  under  the  optimal  policy 
the  expected  cycle  length  is  42.15  periods  and  for  37*44  of  these 
periods  the  process  operates  in  the  good  state.  On  the  average  the 
process  operates  in  the  bad  state  for  4.50  periods  before  a  repair  is 
made.  The  overall  fraction  of  defective  items  produced  is  .0303  and 
24.6^  of  the  time  an  erroneous  repair  is  made  to  a  process  still  in  the 
good  state. 
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One  common  criticism  of  the  control  approach  using  posterior  proba¬ 
bilities  is  the  difficulty  of  implementation.  This  criticism  is  ill 
founded  in  this  particular  example.  By  examining  the  transition  matrix 
in  Table  I  one  sees  that  a  posterior  probability  exceeding  .70  can  occur 
in  only  two  ways.  The  zeroth  item,  produced  immediately  after  repair  is 
always  ignored.  If  no  defective  item  occurs  in  items  1  through  14,  then 
repair  is  made  on  the  occurrence  of  the  first  defective.  If,  however, 
a  defective  item  is  observed  in  items  1  through  l4,  then  repair  is  made 
on  the  occurrence  of  the  second  defective  item. 

Example  2 

Again  let  n  =  .02,  p^  =  .99  arid  p^  =  .80.  The  direct  cost  of 
each  item  produced  is  .40  units.  The  selling  price  of  an  item  is  1,00 
units  and  each  good  item  produced  can  be  sold.  When  production  is 
stopped  upon  suspicion  that  the  process  is  in  the  bad  state  two  things 
occur.  First  a  detailed  examination  is  made  to  determine  if  the  process 
has  truly  broken  down.  This  examination  takes  2  periods  of  time  and 
costs  .20  units.  If  the  process  is  found  in  the  bad  state  a  repair  is 
made  which  takes  5  periods  of  time  and  cost.s  .80  units,  ITie  ob.jeotive 
is  to  maiximize  the  expected  profit  per  time  period. 

The  expected  cycle  length  given  in  Table  II  is  now  the  expected 
number  of  periods  in  a  cycle  that  the  process  is  in  production.  To  get 
the  true  cycle  length,  ari  amount  representing  repair  time  must  be  added. 
One  uses  tb'^-  columns  giving  the  fraction  of  machines  repaired  which  are 
good  and  defective.  At  a  critical  value  of  .70  this  yields 
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E[N]  -  42.15  +  2  +  .75^  X  (5) 

=  46.41 

During  a  cycle  42.15  items  on  the  average  will  be  produced  at  an  item 
cost  of  .40  units  each  to  yield 

Item  Cost  -  42.15  X  .40  =  l6,86 

Of  these  (l  -  .0503)  x  42.15  will  be  good  items  which  may  be  sold  for 
1.00  units  each  to  yield 

Item  Return  =  .9697  x  42.15  =  40.87 

The  average  cycle  repair  cost  will  be 

Repair  Cost  -  .20  +  .754( .80)  =  ,805 

This  yields,  for  a  critical  value  of  .70  the  average  profit  per  period 
of 


^  =  (40.87  -  16,86  -  ,80)  A'  .41  .  .500 

Repeating  these  calculations  for  several  cl  Ices  of  cri'tcal  values  one 
arrives  a"  Table  IV.  The  optimal  critical  value  is  -70.  By  referring 
again  to  Table  11  one  may  calculate  that  the  rale  of  production  of  good 
items  is 


42.15(1  -  .0505) 

46 .4i 


.8807  items/period  . 
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Critical 

Value 

Total  Oyclf' 
Length 

Prof i t 

Pei-  Period 

.40 

41.90 

.4992 

.45 

42.51 

.4995 

.50 

42.51 

.4995 

•  55 

45.12 

.4996 

.GO 

45.55 

.4993 

.65 

1*4.29 

.4999 

.70 

46.4] 

.5000 

.75 

60. ^^3 

.4997 

.80 

61  .  I4 

.499^i 

Table  IV  This  table  lists  the  expt^''ted  profit  per  pf'-r iod  for  each  choice 
of  critical  value  for  the  probi.em  given  as  Example  2.  The  maximum  profit 
is  seen  to  occur  at  a  critical  value  of  .70. 
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SECTION  ^  -  VALIDITY  0'=’  THE  SOLUTION 


The  validity  of  the  r.roposed  soiution  is  checked  in  two  ways. 

First  several  inequalities  whlf-h  t.he  proposed  solution  must  satisfy  are 
developed  and  the  solution  is  checked  af-^ainst  them.  Second  the  problem 
is  solved  anew  through  the  method  ol‘  discounted  cost  dynam.ic  programming 
a..;  this  answer  compared  to  the  origisial. 

Consider  the  situation  depicted  earlier  in  Example  1  where  repair 
is  instantaneous  and  has  a  cost  of  one  unit  irrespective  of  the  state  of 
the  process  at  the  time  repair  is  made.  Let  c  he  the  cost  of  a 
defective  item  and  let  n ,  and  p^  have  the  same  meaning  as 

before.  Let  y  be  the  average  cost  per  period  assuming  that  the  state 
of  the  process  were  known. 

■V  =  Repair  Cost  +  Item  Cost 

(5.1) 

=  Tt+c(l-p) 

■^o 

If  y  is  the  minimum  cost  assuming  the  nrocess  state  unknown  then 

2  <  X 

To  get  an  upper  bound  on  the  solution  one  realizes  that  the  cost 
under  an  arbitrary  policy  must  be  greater  than  the  cost  of  the  optimal 
policy.  The  arbitrary  policies  considered  are  of  the  form: 

"Repair  every  m  periods"  for  some  constant  m. 

Let  N  be  the  number  of  periods  that  the  process  is  in  the  good 
state,  and  let 
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a  -  Pr  [  N  -  n  ]  -  ( 1  -  :n )  ^ 

n 


b^=Pr[N>n]=  ^  a^=(l-rt) 

k=n 


n-1 


Tvo  identities  are  used. 


r  a  =  (1  -  -  (1  -  nY 

i-k 


(5.2) 


rr.-l  m- 1  m-1 

^  na  =  X  Z  • 


n=o 


k=l  i=k 


=  {[1  -  (1  -  n)"'’-‘-]A]  -  (m  -  1)(1  -  (5.3) 


— rn 

If  y  is  the  average  cost  per  period  under  a  policy  of  this  form  then 


-m  1  r 

y  -  l/m  +  c(l  -  p^)  +  -  'I  Z  c(pj^  -  r^)^\  +  t'm(p^  -  p^)b 

k=l 


m 


=  c(l  -  p J  +  -  [c(p  -  P.)A  1]  - 
1  m  i  o 


:(Pn  -  P„) 


(1  -  n)"’  (5.U) 


nm 


To  simplify  this  expression  let.  p  p.^  -  Pq)A  and  use  the 

approximation  for  large  m.  and  small  n 


-rroi  ~  /  .  \  m 

e  =  (1  -  jt) 


One  gets 


y  =c(l-p,  )  +  (]-t3)-+-e 
1  mm 


=  c(l  -  p^)  +  (tt  -  ■J)0  -  l)  +  ^  e""^ 


m 


m 


(5.5) 
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For  m  -  —  this  reduces  to 

JT 


y 


c(l  -  Pq)  +  c(p^ 


PjX-;) 


(5.C) 


Thus 


•y  't  "y  <  i  nP  y  y 

m_>  O 

For  Example  1 

y  =  .0200 

y  =  .0419 

inf  7”^  =  .0665 

m  >0 


The 

decision 

Let 


discounted 
problems  is 
a 

K 

c 

g(o:y  x) 
C(x)  = 


cost  dynamic  programming  approach  to  sequential 
well  known. 

be  the  discount  factor  such  that  a  unit  of  value  one 
period  hence  has  a  present  value  of  Ct^; 
be  the  cost  of  repairing  the  machine ; 
the  cost  of  a  defective  item; 

the  minimum  expected  total  discounted  future  cost 
c[x(l  -  p^)  +  (1  -  x)(l  -  Pq)]. 


If  a  minimum  cost  rule  exists  then  one  can  easily  show  that 

/ 


K  +  CCx"")  +  QE  ^g(a,  T^°) 


;(o;,  x)  =  min  \ 


c(x)  +  aE^g(a,  T^x) 


(5.7) 
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Dol’man  [3]  has  rigorously  shown  that  such  a  rule  exists  and  is  given  by 

"Repair  at  time  t  if  and  only  if  X'^eR^"  where 

'  t  a 

Rq,  ^  (x:  g(a,  x)  -  K  +  C(x°)  +  OK  qE(Q:,  TyX°)]  (5-8) 

X 


One  usefulness  of  this  theory  lies  in  the  fact  that  Equation  (5-7) 
may  be  solved  in  a  straightforward  manner.  One  defines  x)  =  0 

for  all  xe[0,  l]  and  then  computes  recursively: 


=n+l 


(a,  x)  =  min  \ 


K  +  C(x°)  +  aE  T^x®) 


C(x)  + 


(5.9) 


It  is  easily  shown  that  for  every  O:c[0,  l)  the  sequence  of  functions 
(g^(a,  •)}  converges  uniformly  and  monotonicaiiy  to  a  rounded  limit 
function  gia,  *)  which  is  the  unique  bounded  solution  to  the  functional 
Equation  (5.7). 

The  general  theory  shows  that  "The  Existence  of  an  Optimal 
Stationary  Non  Randomized  Rule  in  the  Average  Cost  Case"  shows  that 


lim  g(a,  o)(i  -  a)  =  y 
a^  1 


and  for  some  subsequf-nce 


} 


lim  R  =  R* 
k-»oo 

where  R*  is  the  optimal  repair  region  under  the  average  cost  per  period 
criterion  and  y  is  the  minimum  average  cost  per  period. 
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Thus  a  means  is  provided  for  checkin/:^  the  proposed  solution.  For 
the  case  considered  in  Example  1,  Equation  (5*7)  was  solved  numerically 
for  va''. ues  of  oc  of  -9^,  •99>  ‘999 i  ‘999 • 

It  should  be  remarked  that  convergence  v/as  extremely  slow  and  in 
order  to  get  meaningful  results  it  was  necessary  to  begin  the  iteration 
with  a  function  close  to  the  solution.  However,  the  results  w'  re  very 
close  to  'hose  computed  earlier  as  may  be  seen  in  Table  V,  ver.fying 
the  computational  procedure  used  i.n  the  average  cost  case. 


Discount 

Factor 

a 

Grit.  Val 
Defining 

( l-a)x 
g(a,o) 

( l-o:)x 

( i-a)x 

max!g(a,0-[Tg(a,  •)  ](0  1 

g(Q:,o) 

VO 

00 

.77 

. 03817 

.05817 

.0+150 

.002 

1.909 

.99 

00 

cn 

ro 

0 

.04958 

.0+125 

.  001 

5.958 

.995 

■  13 

.OUoUl 

.04541 

.0+127 

.001 

8.082 

.999 

‘12 

.04111 

.04211 

.0+129 

.  001 

41 . 110 

Table  V  Solution  of  Example  1  by  the  discounted  cost  dynamic  programmitig 
technique.  For  large  Cc  the  critical  value  should  be  near  the  earlier 
result  of  .70.  The  third,  fourth  and  fifth  columns  should  be  compared 
with  the  average  cost  per  period  y  =  .04l91  computed  earlier.  The 
relation  should  be 

(1  -  a)g(a,  o)  <  y  <  (1  -  a)g(a,  1)  . 

r.' 

The  modal  point  of  the  stationary-  disti'ibut ion  for  X  is  denoted  , 

M  ^ 

and  (1  -  Cx)g(Q,  I  )  should  approximate  7.  The  last  two  colum.ns  are 

given  to  evaluate  how  well  the  numerical  solution  satisfies  the  equation 

g(a,  •)  =  Tg(a,  •). 
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SECTION  6  -  SENSITIVITY  ANALYSIS 


Before  one  may  apply  the  optimal  control  technique  proposed  in  t.his 
paper  one  must  estimate  the  process  parameters  n ,  p^  and  .  Suppose 
Lhese  are  estimated  incorrectly.  A  means  of  detecting  incorrect  estimates 
has  already  been  given;  compare  the  actual  cycle  lengths  and  fraction 
defectives  produced  with  the  predicted  values  for  these  quantities.  But 
still  unanswered  is  the  behavior  of  the  process  under  a  control  rule 
based  on  incorrectly  estim.ared  parameters.  This  section  provides  a 
means  for  answering  this  question. 

It  is  assumed  that  the  estimates  of  the  parameters  are  n,  p^  and 
p^  but  that  the  true  values  are  n',  p^,  and  p^ .  The  controller  has 

computed  an  optimal  critical  va’ue  based  on  his  estimates  n ,  p^ 

and  p^  and  the  process  will  be;  controlled  as  before  through  the 
sequence  t  =  0,  1,  ...  )  defined  as  before: 


^  Y  ^ 


where  the  estimated  values  n,  p^,  and  p^,  are  used  in  defining  the 


transformation  t 


y 


However,  the  (X^,  t  =  0,  1,  ]  process  no  longer  has  the 

Markov  property,  in  general,  and  its  transition  probabilities  also 


depend  on  the  unknown  parameters  n  '  ,  p^  and  p^'  . 

The  technique  proposed  in  the  Girshick  and  Rubin  paper  affords  a 
means  of  analysis.  One  considers  the  bivariate  process 
((X^,  ) ,  t  =  0,  1,  )  whifdi  enjoys  the  Markov  property  with 

transition  probabilities  given  in  Table  VI. 
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Transit  ion 


From 

L  L 


O 


TransU  ion 
Probabilit V 


(x,  0) 

(To>:, 

0) 

-  i; ' ) 

(x,  0) 

(^fX, 

0) 

(1  - 

Pp  ( 1 

(x,  0) 

(TqX, 

1) 

D'n  ' 

"  o 

(x,  0) 

(t  ,x, 

X 

1) 

(1  - 

Po’”' 

(x,  1) 

(TqX, 

1) 

(x,  1) 

(t^X, 

1) 

(1  - 

') 


Table  VI  The  possible  transitions  with  corresponding  probabi 1 it i ?s  for 
the  bivariate  process  f  =  0,  1,  ].  These  resuits  nold 

only  for  x  not  in  the  repair  region  R. 


Let  be  a  row  vector  v/here  is  the  expected  number 

J  J 

of  times  in  the  first  cycle  that  the  {(X  ,  8  ),  t  =  0,  1,  •••  ]  proces 

L*  V 

is  in  state  ( x'^ ,  O)  for  x'^  not  an  element  of  t.he  repair  region  R. 

Let  H°  =  be  the  transition  probability  matrix  corresponding  to 

^  J 

transitions  of  the  form  (x,  O)  (t  x,  O)  for  x/R  and  t  x/R  .  Then 


/ 

P^(l  -  n-) 

<  (1  -  p^)(l  -  TT-) 

0 

\ 


if  X 

if 

otherwise 


=  T  X 

o 

x'^  -  -^X 


i 

i 


By  an  analysis  entirely  similar  to  tliat  used  in  developing  Equation  i2.b 
one  has  that  il/°  is  the  unique  soluuion  to  the  infinite  set  of  linear 
equations : 
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4'°  =  Z  ^ 

J  ^  J 

xVr 


and  \lr°  =  1. 
o 


Let  'l^'  =  ('If'. )  be  a  row  vector  where  ^ '.  is  the  expected  number 
J  J 


of  times  in  the  first  cycle  tha^  the  ((X  ,  S.  ) ,  t  =  0,  1, 

L«  c 


]  process 


is  in  state  (x*^,  l)  .  In  the  case  where  it  =  n  '  p  =  p'  and  p.,  =  p’ 

^  o  o  1  1 

one  would  have  x'^'ir?  =  (l  -  x"")\lf'.  and  this  is  the  approach  Girshick  and 

J  J 

Rubin  suggest.  For  the  case  at  hand  a  new  system  of  equations  must  be 
developed  for  the  '  vector.  Again  the  expected  number  of  times  the 
process  is  in  any  particular  state  is  equated  with  the  sum  of  the  expected 
number  of  times  the  process  is  in  a  preceding  state  weighted  by  the 
probability  of  a  transition. 

Let  H'  =  (ill.)  be  the  transition  probability  matrix  corresponding 
^  J 

to  transitions  of  the  form  (x,  l)  (t  x,  l)  for  x^R,  and  r  x^R. 

y  y 

Then 


t.i  M  -  ph 


0 


.  ,  J  1 

11  x^  =  T  X 

o 

if  x"^  =  T,x^ 


otherwise  . 


Let  H"  =  transition  probability  matrix  corresponding 

to  transitions  of  the  form  (x,  O)  — >  •  Then 


p'n  ' 
o 


(1  -  Pq)«' 

0 


if  x*^  -  T  x^ 

o 

if  x^  =  T  x'^ 


otherwise 


50 


I 


tn 

O 

u 

OJ 

CL. 

(D 

Jh 

c 

<L' 

o 

-p 

-P 

♦rH 

o 

C 

4-5 

a) 

3 

CJ 

Cm 

O 

Oj 

<D 

o 

E 

M 

C 

w 

x: 

0)  -t-> 

r-H  M 

V  c 

>2  <u 

CJ 


O  M 

>3  C 

o  <u 


cn  • 

C  rO 

cd  O  t=; 

f-<  }-< 


52.41  .0492  .  0486  57 -36  .  0415  .  0425 


<u 

Eh 


p 

CO 

(D 

cn 

p 

Pi 

cd 

CD 

(-H 

(V 

(D 

(d 

e: 

CO 

eg 

r — 1 

4-> 

rH 

<D 

CJ 

f—H 

d 

rH 

P 

w 

r-^ 

•rH 

•rH 

o 

bO 

cn 

4D 

4-5 

> 

O 

p 

'D 

CD 

U 

-M 

e: 

o 

CO 

O 

<D 

C 

o 

o 

(D 

CD 

o 

3 

p 

-P 

W 

o 

E 

p. 

•rH 

CO 

g 

a; 

(D 

P 

CD 

•rH 

!D 

4-5 

f-H 

x: 

o 

3 

3 

cd 

p> 

c 

P 

CO 

h 

::3 

-P 

0; 

(d 

•rH 

-p 

Pi 

(U 

> 

4-5 

a 

•rH 

p 

(D 

>> 

to 

cd 

cd 

e; 

t — 1 

<v 

CO 

Eh 

4-5 

03 

CJ 

4-> 

w 

o 

o 

X 

f-H 

p 

(V 

•rH 

a; 

P 

w 

. 

4-5 

rH 

CO 

o 

1 - 1 

•rH 

r-H 

• 

(U 

o 

(DO  ?H  O  W 

Td  CJ  O  El  C  Td 


O  C  S  (D  (D 

S  -rH  oj  x  3  x: 

x:  o  I— I  H-i  (D 

(D  E  H  O  O  <-j 

x:  0)  owe 

4-J  rH  (D  (D  3 

I-I  •  x:  :  >  o 


p 

o 

CO 

■P 

od 

•p 

o 

• 

o 

p 

c 

CJ 

hO 

c 

p 

s 

•K 

p 

ID 

••P 

cn 

e 

3 

CO 

cd 

:5 

P 

•H 

o 

rH 

CJ 

P4 

o 

P 

o 

CO 

o 

o 

:3 

•P 

p 

CD 

(D 

>> 

o 

p 

o 

e: 

P 

(D 

cd 

•H 

p 

p 

P 

Cd 

Jd 

; 

> 

•M 

w 

o 

O 

c 

Eh 

G 

cd 

o 

cd 

05 

Td 

< 

— 1 

<D 

c 

CD 

(—• 

Td 

>> 

• 

3 

g 

<D 

P 

CD 

4-5 

o 

CO 

3 

CD 

P 

•H  oo 

CO 

CO 

e: 

Em 

4-5 

> 

• 

< 

CO 

p 

Cd 

g 

•rH 

r 

cd 

x: 

•P 

4-5 

11 

e 

• 

4-> 

P 

•rH 

q; 

0) 

•H 

cn 

CO 

CO 

rH 

.c 

x: 

q 

CD 

CD 

4-5 

e 

; 

o 

CJ 

(D 

3 

•p 

CD 

CO 

a 

c: 

> 

p 

p 

P 

•H 

o 

•P 

9 

o 

Cd 

cd 

c: 

CJ 

s 

Cd 

r  • 

Td 

CO 

to 

5 

Oj 

• 

r 

CJ 

> 

CO 

O 

Td 

• 

OJ 

ON 

•iH 

cd 

P 

CJ 

CO 

p 

•rH 

ON 

bD  CQ 

(D 

p 

OJ 

g; 

• 

CD 

dd 

Cd 

to 

•\ 

4-) 

•P 

cd 

g 

ll 

CJ 

. 

x: 

Lm 

cd 

P 

g 

p 

CO 

p 

dd 

cd 

3 

o 

rH 

p 

bO 

O 

dP 

to 

Ph 

Cd 

CJ 

d.: 

o 

P 

> 

rP 

OJ 

c 

0; 

CD 

CJ 

g 

r-H 

M 

p 

x: 

— H 

•n 

CJ 

3 

r 

OJ 

p 

evi 

d! 

OJ 

G 

Cd 

o 

*-5 

r-| 

OJ 

3 

dd 

H-5 

• 

Td 

O 

p* 

p 

(D 

•r* 

OJ 

>:, 

p 

cd 

x: 

CO 

'1 

Cd 

§ 

CJ 

Qh 

:* 

•rH 

05 

3 

c 

x: 

p 

CO 

CD 

•p 

CD 

Td 

&H 

CO 

CO 

x: 

dd 

o; 

cd 

P 

c 

P 

> 

CO 

•H 

OJ 

4-5 

CD 

i-H 

p 

CD 

p 

> 

•p 

-H 

CJ 

to 

CO 

CD 

•p 

CD 

x: 

>• 

w 

05 

0; 

bO 

'  xd 

o 

CJ 

CO 

r-^4 

'"1 

*-5 

cd 

CD 

a 

p 

4-5 

,  j 

OJ 

rH 

cd 

O 

CO 

to 

zt 

.Q 

P 

TP 

rn 

o 

O 

CJ 

cd 

cd 

cd 

;r! 

o 

c: 

x« 

CO 

x: 

P4 

cd 

p 

CD 

p 

dd 

p 

31 


The  vector  '  is  the  unique  solution  to  the  infinite  system  of 
equat ions : 


'  + 

X 

To  investigate  the  behavior  of  the  process  under  incorrectly  chosen 
pareimeters  one  first  finds  the  critical  value  i*  defining  the  repair 
region  that  the  controller  will  use,  based  on  his  incorrect  estimates 
It,  p^  and  p^ .  This  repair  region  completes  the  definition  of 
Equations  (6.l)  and  (6.2)  which  are  then  solved,  using  the  approximation 
technique  discussed  in  Section  to  yield  the  vectors  \lt°  and  'If'. 

Then  m^,  the  number  of  periods  during  the  first  cycle  that  the  process 
is  in  state  0,  for  SefO,  1}  is  computed  by 

O  V  1 

xVr 

■»!  =  I 

x^/R 

The  cycle  length  is  m^  +  m^.  From  these  three  numbers  the  behavior  of 
the  process  may  be  computed  for  many  simple  models.  The  results  of  such 
an  analysis  performed  on  the  case  of  Example  1  is  given  in  Table  VII. 


?  (6.2) 
Vr 
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SECTION  7  -  CONCLUSIONS 


The  simple  Bernoul ] i  case,  where  sampling  inspection  is  by  attri- 
bates,  of  t.iie  Girshick  and  Rubin  ‘quality  control  model  has  been  studied 
in  detail.  A  nurnei'icalJy  feasible  means  of  calculating  optimal  solut  ioi. 
has  been  demonstrated.  The  nature  of  the  solution  is  such  tiiat  once 
taijl  es  of  operating  characteristics  have  i'Cen  prepared,  the  solution  ’o 
a  wide  variety  of  problems  miay  be  had  th.rough  sliglit  additional  ha  . 
calculations  from  the  tables.  The  solution  is  optimal,  in  the  sense  ol' 
minimizing  the  average  cost  per  unit  time.  It  also  appears  relatively 
insensitive  to  errors  in  the  estimates  of  the  model  pai-ameters  and  a 
means  of  calculating  this  sensitivity  is  provided.  A  means  of  checking, 
over  a  long  period  of  time,  whether  or  not  estimates  are  correct  has 
also  been  suggested.  It  has  been  shown  that  the  optimal  solution  is  not 
necessarily  difficult  to  implement. 

Of  course,  further  work  remains  to  be  done.  The  entire  non  lOOlo 
inspection  case  needs  to  be  solved  from  beginning  to  end.  A  means  of 
estimating  the  model  parameters  should  be  found.  Some  work  should  be 
done  on  simplifying  the  form  of  the  rule  to  ease  implementation.  And, 
assuming  that  the  model  is  realistic  enough  so  that  there  is  some  demand 
tables  of  operating  characteristics  should  be  prepared. 


APPENDIX 


A  DETAILED  DESCRIPTION  OF  THE  NU^'ERICAL 
SOLUTION  lETHOD 

The  proposed  niunerical  solution  has  two  distinct  phases.  In  the 
first  phase  a  finite  transition  probability  matrix  which  approximates 
the  natural  infinite  matrix  is  computed.  In  the  second  phase  a  set  of' 
linear  equations  is  solved  for  each  of  several  critical  values.  Each 
solution  determines  the  operating  characteristics  of  the  rule  using  tlie 
corresponding  critical  value. 

The  computations  were  carried  out  through  the  facilities  of  the 
Stanford  Computation  Center.  Not  only  did  the  Center  pi'ovide  free  com¬ 
putation  time  but  also  many  "software"  aids.  The  Gaussian  elimination 
procedure  used  here  is  a  minor  variation  of  one  of  their  library 
procedures . 

The  program  was  written  in  Burrough ' s  Extended  Algol  language. 
Since  this  differs  from  Algol  almost  solely  in  the  provision  for  inpul 
and  output,  the  description  of  the  numierical  solution  method  will  consi 
of  a  presentation  of  the  program  with  annotated  comments. 

Names  of  Variables 

AA[0:  LL,  0:  LL]  ,  a  square  array  of  coefficients  in  the  linear 

equat ions . 

ASYP  ,  a  value  about  which  posterior  probabilities 


tend  to  cluster 


BB[0:  LL] 


the  right  hand  side  of  the  linear  equation 


DM  IN 

DMAX 

EPS 


FS[0:  LLL] 

LL ^  LLL^  and 

MO,  Ml 

NFG1[0:  LL], 

PI 


LMAX 


set . 

,  the  deviation  between  an  exact  "TO  STATE"  and 
the  state  in  ?  lie  finite  list  which  nearest 
approximates  it. 

,  the  largest  of  the  DMIN's  above. 

,  all  states  withi:!  EPS  of  the  cluster  value 
ASYP  are  grouped  into  two  classes,  those  abov^- 
and  those  below  ASYP,  riach  class  is  then 
assigned  a  common  state  to  represent  all  states 
in  the  class.  EPS,  then,  is  a  variable  deter¬ 
mining  the  degree  of  approximation  involved, 

,  he  list  of  states,  or  "FROM  STATES"  used  in 
the  approximation, 

,  LMAX  is  the  largest  allowable  transition 
matrix  size;  LL  is  the  matrix  size  used  and 
LLL  =  LL  +  1. 


,  the  number  of  periods  per  cycle  that  the 
machine  spends  in  the  good  and  bad  states, 
respectively. 

NFG2[0,  LL]  ,  the  state  number  to  which  a  transition  occurs 
in  the  event  that  a  good  or  bad  item  is 
observed,  respectively, 

,  the  transition  probability  that  in  a  single 
period  a  good  machine  will  go  bad. 
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PO,  PI 


PMAX 


PCRIT 


PCR 


RO 


TS1[0:  LL],  TS2[0:  LL] 


TSP1[0:  LL],  TSP2[0:  LL] 
X[0:  LL] 


XO 


Y 


,  the  fraction  of  good  items  that  a  machine 
in  the  good  or  bad  state  will  produce, 
respect ively . 

,  the  largest  allov/able  posterior  probability 
state . 

,  the  lai'gest  posterior  probability  state 
encountered . 

,  a  dummy  variable  running  through  critical 
values . 

,  the  fraction  of  repaired  machines  v;lich  are 
defective . 

,  the  states  to  which  a  transition  is  made  upon 
the  observance  of  a  good  or  bad  item, 
respectively.  The  "TO  STATES." 

,  the  probabilities  of  the  above  transitions. 

,  the  vector  of  unknowns  in  the  linear  equation 
set . 

,  the  overall  propor"  Lon  of  defective  items 
produced . 

,  a  dummy  variable  running  through  posterior 
probability  values. 
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►iftil'J  C  Tm^  "I^l^aTI'IG  Cr^A^ACTE^ISTICb  OF^  A 

c:)i^i..  'j.r.  AS  .\  ''I'gcrir;  :r  1  .,r  :  I T  K  A .  VA_JE  IT  HE  BJlE.  IN^JT  IS 

»!•  1-I*:  Tc..Mi:)\  -'-ij  <..-ir.i  TY  •"  t-t  MAr-ir^r,  /-j:*  (pj),  the  phaction 

T'  "t'-n:  iT;-r.  ,  u.-ivir  in  i^f  r.rj-o  (=.'.o)  ntaie  hill  phodjce.  « 

HEA^  AO#  '•l»  Y#  EPS*  PHAY*  ASYP  i 

I'-TESL''  _ »  .'IAy; 

L**^Et  i 

LAHt,^  'I  'I  f 

*<£«.  •  •■.HEl'v.HE  :(V);vitJE  Y;5fA_  Y;qrMN  D*- (  ^  1 0  )  *  Y  ♦?  0 ;  END  Oi 
real  APJCEJiRE  A(t);vAi.JE  YlRfAt  YIHLjIN  a«-(  (  pi -pi  upo  )«Y*PI»P0  )/D(  Y 
END  a;-I£A^  pRJC-;:j-.E  piyUvAuJE  yIPEAl  yIBEGIN  Rt'C  (  (  1-Pl  )-PI»(  l-PO)  )«Y  + 
(  l-POJxPI  )/(  l*3f  V  ;  )  JENJ  n;  peal  PPrDCEOJPE  A  I  NV(  Y  ) ;  V  A;.UE  Y)  REAL  TJ 
begin  AIn\‘»(  Y-pt  )xP0/(  (PO-Pl  iKY^Pl-PIxPO);  END  AINV; 
integer  ppnCtD^RE  SUEf  rPS)J  YAlJE  EPSJREAl  EPS> 

BEGIN  lahEl  lIwiTa;  inteuER  !»•;;  real  y;  y»o;  i*-Oi 

EDH  H^-CSIEP  IaHIlE  ISl^AX  OD  PEr.lN  IE  Y<ASYP-EPS  THEN  Y»A(Y)  ElSE  IE 
YJASYP  THEN  YfiilNYfY)  LlSE  BEGIN  Y  ••  A  I  N  Y  (  A  S  YP  ♦£PS  ) »  I  ••  I  ♦  1  »  END!  IF  Y>PMAX 

Then  go  Tn  nuia; i»i  +  i;end;outa:5I7E‘-ie  i<lhax  Then  i  else  lmax;eno; 

uHax»  7bi  OMAX*  d. c’; 

STARTIRFADCPI.  PQ*  PlI*  A S Y P* P I « pO/ ( PO-P 1  )  > 

LL«-5IZE(0.02);  rPo-0,02;  IE  LL<LMAX-ia  ThEN  BEGIN  LL«-S  I  Z  £  (  0 , 0 1  )  F  EPS* 

O.OIFENDFIF  LL<t,'^*><"10  Then  BEGIN  LL*S  I  Z£  C  0 , 007  )  ;  EPS*0, 007)  ENDF 
LLL*lL*1) 

BEGIN 

REA^  DHAX.  OMlN.  »CPIT.  PCR) 

REAu  HO*  HI,  XO*  HO  ) 

INTEGER  I. J.X*H*N1*N2J 

REAt  ARRAY  rs» rSl,TS2,TSPl,TSP2C0ILLL]) 

INTEGER  ARRAY  NFG I , NEG^ t 0  I lLL  )  ) 

REAi.  ARRAY  AAt  Dl^^.OILLl.  H3*XC0ILL3J 

PROCEDURE  GAUS.Sa(H,NI*N?,a.9,X,S1NG);valUE  H*NI,n2)  INTEGER  M.Nl»N2) 
real  array  AtD,OI,R,X[()])  LABEL  SING)  BEGIN  INTEGER  I  ,  J  ,  I M  AX  »  «  ,  LJ 
real  H/,T,iiJOT) 

PROCEDURE  ElIHC<p1*n*3J0T.A,b)»VALUE  <Pl,N,aJOr)  integer  N»«P1) 
real  auOT)  real  array  A,9to])  begin  integer  d  for  i*k»i  step  until  n 

DO  .Am*AC  n-ajOTx0t  I  j;  END  ElIH) 

H*M-1)  Nl*Nl-l)  N2*N2-l»  EJ?  '<*NJ  STEP  lUNTI.  N2  00  BEGIN 
HX*0)  IHAX*X)  FOR  I*K  STEP  UINTIl  N2  00 

IE  hx<abS(a[i,<J)  Then  begin  hx* absc ac l , x 3 ))  ihax*i)  eno) 

IE  HX  »  0  Then  go  to  SING) 

I*X)  IE  K  X  IHAX  Then  BEGIN 

J  *  IHAX)  T*aci3)  3tI3*3[J])  atJ3*T)  EOR  L*0  STEP  I  UNTIL  M  00 
BEGIN  T*AtI,L3)  AtI,L3*At J,L3)  ACJ*L)*T)  END)  ENO) 

EOR  J*X*1  STEP  lUNTIt  H  QO  BEGIN  OUOT * A t J* K 3 / A [  I  , K 3  )  IE  QUOTXO  THEN 
BEGIN  BC  J3*3C  Jl-Bt  <  3>iOjOT)  EL  I  H(  X*  I  ,  H,  8U0T  ,  A  t  J,  *  3  ,  A  t  K,  *  3  )  )  END) 
ENO)  END) 

EOR  I*N2  step  -I  until  0  DO  BEGIN 

T*0)  EOR  L*-I*l  STEP  UNTIL  N2  DO  T*  T*  A 1 ,  L  3  »  X  f  L  1 ) 
XCI3*(Btn-T)/A(I,n)  END)  ENO  OE  GAUSSA) 

COMHENT  THIS  GROUP  OE  INSTRUCTIONS  COHPuTES  THE  TRANSITION  PROB¬ 

ABILITY  hatrix  corresponding  to  The  process  RHicH  tracks  The  post¬ 
erior  probabilities  on  the  machine  state,  ) 
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PROGRAIvl  EXPLANATION 


1.  Several  functions  are  defined.  Y  always  represents  the  probability 
that  the  machine  will  be  in  the  bad  state  for  tlie  production  of  tlie 
next  item.  D(Y),  then,  is  the  probability  that  a  good  item  is  pro¬ 
duced.  A(Y)  is  the  next  posterior  probability  given  that,  a  good 
item  is  observed.  B(Y)  is  this  probability  upon  observing  a  bad 
item.  AINV(y)  is  the  inverse  function  to  A(Y). 

2.  The  function  SI7.E(EPS)  gives  the  approximating  matrix  size  as  a 
function  of  the  approximation  constant,  EPS.  It  does  this  by 
quickly  going  througii  the  approximating  procedure  and  counting  the 
size  of  the  resulting  matrix. 

3.  The  matrix  size  for  several  values  of  EPS  is  com.puted.  The  pro¬ 

gram.  selects  £  value  for  EPS  which  results  in  a  matrix  size  near 
to  but  less  than  Lf-'AX . 

4.  The  input  variables  to  the  GAUSSA  procedure  are:  A,  an  M  x  M 

matrix  of  cc' ff icients;  B,  an  M  vector  of  constants;  X,  an  M 
vector  of  unknowns  aitd  SING,  a  label  to  which  control  passes  should 
a  singular  matrix  be  found.  If  this  procedure  is  executed  for  a 
value  of  N1  =  1  and  N..  --  K  then  the  values  appearing  in  X[I] 
for  I  =  1,  2,  ...  ,  K  are  the  solutions  to 

K 

X  A[I,  J]X[J]  =  B[I]  ;  1  =  1,  .  .  .  ,  K 

J=1 

If  next  the  procedure  is  called  for  a  value  N1  =  K  +  1  and 
N2  =  L  then  X[  ]  contains  the  solution  to 

L 

X  A[I,  J]X[J]  -  B[I]  ;  I  =  1,  .  .  .  ,  I, 

J=1 

And  so  on,  extracting  the  solution  to  increasing  subsets  of  equations 
while  solving  the  largest  set. 
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CO  ENT  riRST  TIE  ALL.E'WAhlF:  states  in  the  APPR^TXIMATION  ARE  COM¬ 
PUTE)  ANjo  st:i-(eo  in  rs[  j  ; 

TON  ■(►OIjTLP  1  .YHliE  1<LL  T;.')  REGIN  EScn^Y; 

IP  Y<ASY^-t^5  HEN  begin  TSlin.-ACYTENFGlCn*-!*!;  TSP1CI]*-DCY)J 
TSP-'tiJM-i'iY);  Y-A(Y);  eng 

ELbi  IF  Y?a;5Y^  T -i  L  N  jE.GIN  T  S  1  C  IT  F  G  C  I  -  1)  >  N  P  G  1  [  1  3  I  -  1  )  T  bP  1  t  I  ]  •■  0  (  Y  3  i 
TSPPEIIM  - Y-AIN\/(Y);  EO 

E_SE  -jE:.  In  T5l[I-ll«-PS[I3»-Y-ASYP-0.3:ixEPS;  Tblin^Y;  NFGICI]*-!; 

T  b '  H  M  ‘  -J  ( T  3 ;  r  2 1  n  1  > :)  ( Y  3 ; 

i^^i*'.;  Y*ASiJto.i3x£Pbi  psin^T.sici3*-Y;  nfgi[I3»-i;  tspi[ii»-dcy3; 
TSPf[I3«l-G(Y3;  Y‘-AInv(A5yp  +  EPS3;  end? 

I ^ I  + 1 ;  end; 

CD K vent  next  t-i;  vatrix  15.  pill^-'  in  YiiiH  A  ••rn"  state  being 

A  p  P  N  ^  f,  T  E  :  .) )  its  N  E  a  R  E  b  t  N  f  I  g  a  d  -<  ; 

Dvax^-C.G;  PCrIT*-'SCl.l3;  PbC_uu3-D.9999v; 

PDK  I*-CSTEP  IJNTU  'D  t'l  D'iIN*-O.Nn;;  Y«-H(FS[I]3; 

IP  Y>?CRnO'iAX  T-iEN  ■EGI’I  T52[n«-Y;  NP  G  P  t  I  3  ••  9  9 -J  )  EnO 

E_SE  BEGIN  POR  J*-!  STE"  1  uNTIl  Li-  r>3  IE  A3S{Y-P'5CJ33<Dm1N  THEN 

3  EC,  IN  D^lN^ABbCY-PSCjnTX^-j;  END) 

TS?t  1 3»-Psc  <  ];  NP'oPcn'-x;  i"  dvinx^vax  then  dmax*-dmin;  end;  end; 
comment  The  TRANSITION  PROBABILITY  MATRIX  IS  HRITTeN  OJT  } 

BEGIN  P  0  R  M  A  T  P  M  r 1 (  X  A ,  "PI  =  ”,  r  S . 3  ,  X  2  » 

"  P  0  =  ",  -5.3#  X  2  ,  "PI  =  ",  P  S  .  .3 , 

XA  »  "EPb„  =  "#  F5,3/Xa  ,  "MAX,APPRDX,=  "#  P6,a»  X3» 

"matrix  size  O:"#  13# 

XA  I  "ASr=  =  ",  ;5.3  »  XL,  "PCHIT  «=  "»  P5.3  //  3# 

PMT2(  X2n,  "TmE  transition  probability  matrix  IS"  / 


X2#  "state  state 

"STATE  state  HITri 

STATE 
"  / 

STATE 

WITH 

"  » 

X2#  "  NO.  (PR0M3 

"  P  R  0  J  "  /  3  » 

N  0  .  (  T  0  3 

(  T03 

PROB 

NO.(T03  (T03 

PMT3(  X2#  15#  XA#  P5.3#  X5»  15#  XA,  P5.3#  X2»  F5,3»  XA# 

15#  XA,  PS. 3#  X2#  P5,3  3  # 

FITAC  16,  XP,  A(r5.3,  X23#  F6,A,  X2#  I  A , 2 ( X 2 # F 6  .  A  3 3 ; 

LIST  OUTIC  PI#  OQ#  Pi#  EPS#  OMAX#  LL#  ASY®#  PCRIT)# 

OUT3  (  I.  F31I3#  NFr.lcn#  TSlCn,  TSPlCI],  NFr,2[n#  TS2II3# 
T5P2CI]  3  ; 

HRI  TEC  FmTI  #  OUT  1  3  ;  x,  R  I  T  E  (  F  m  T  2  3  ;  FOR  I^OSTER  IUNTIl  LL  C30  HRITECEMTB# 

ojr33;  rsRiTEccpAOEn;  end; 

BEGIN  FDRMaT  THTICXIO# "TRANSITION  PROBABILITY  IS  "#F5.3  / 

xio, "Fraction  op  good  items  produced  by  a  repaired  machine  iS",r6,3/ 

Xio, "PRACT ION  OP  good  items  produced  by  a  defective  machine  IS"»r5.3// 

X5#"CRITICAl  expected  periods  for  fraction  fraction  or  MACH'# 

"  REPAIRS"/ 

X5#"  VALUE  CYCLE  RHICH  MACH. IS  OP  DEFECT,  REPRO  WHCH  ARE  "» 

"  PER  " / 

x5#"  length  -good-  -defect-  items  -good-  -OEFECT-"# 

"  PERIOD"  //3; 

LIST  OUT  1  ( P I # PO# p  1  3  ;  WR I TE ( TMT I #OUT I ) ; end; 

comment  this  group  op  INSTRUCTIONS  SETS  UP  THE  EQUATIONS  WHICH  HILL 
BE  USED  TO  SOLVE  FOR  THE  LONG  RUN  BEHAVIOR  ; 

FOR  J*-OSTEP  lUNTiL  LL  DO  BEGIN  AAtJ»J]*-i;  FOR  I*-J*1STEP  lUNTiL  LL  00 
AA[  I»u]*-AA[  J,  n*-0;EN0;  for  J^OSTEP  lUNTIL  LL  DO  BEGIN  BB[J3»-0i 
I*NFG1[J3;  IP  ISLL  then  A  A  C  I  ,  J  ]  «■  A  A  I  I  ,  J  3  -  T  S  P  1  [  J  ]  ; 


5.  The  relations  among  the  transition  matrix  variables  generated  by 
the  algorithm  is  summarized  as: 

(1)  If  Y  =  FS[I]  <  ASYr  -  EPS  then 

a.  FS[I]  -  A(FS[I-1]),  I  /  0;  FS[0]  -  0; 

b.  NFG1[I]  -  I  +  1; 

c.  TS1[ I]  =  A(FS[ I]) ; 

d.  TS?1[I]  =  D(Y); 

e.  TS2[l]  is  the  state  in  the  list  nearest  to  B(y); 

f .  TSP2[ I]  =  1  -  D(Y) ; 

(2)  If  Y  =  FSlI]  >  ASYP  +  EPS  then 

a.  FS[I]  --  A(FS[I  +  1]); 

b.  NFG1[I]  -  T  -  1; 

c.  TS1[I]  -  A(FS[I]); 

d.  TSP1[I]  =  D(Y) ; 

e.  TS2[l]  is  the  state  in  the  i^st  nearest  to  B(Y); 

f.  TSP2[I]  =  1  -  D(Y); 

(5)  If  ASYP  -  EPS  <  Y  =  FS[I]  <  ASYP  +  EPS  then 

a.  FSl'I]  =  FS[I  -  1]  <  FS[I  +  i]  according  as  Y  <  ASYP 

or  ■  Y  >  ASYP; 

b.  NFG1[I]  =  I; 

c.  TS1[I]  =  FS[I]  =  Y; 

d.  TSP1[I]  =  D(y); 

e.  TS2[I]  is  the  state  in  the  list  nearest  to  B(Y); 

f.  TS?2[I]  -  1  -  D(y); 

6.  Equation  5-2 

(I  -  H)V- 

is  set  up  as  AA'X  =  BB. 

7-  Using  the  modified  Gaussian  elimination  procedure,  the  subsets  of  ■ 

Equation  3-2  are  solved.  At  each  step,  the  operating  characteristics  I 

are  computed  according  to  the  finite  counterparts  of  Equations 
2.12  to  2.16. 

I 
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I  >  f  r.  r  j  ;  i  -  i  s  u  l  i  h  : a  a  (  i ,  j  i  .•  a  a  c  i » j  3  -  t  s  p  2 1  j  ] ;  end; 

;)  ‘  1  ; 

T'i£  tJN.i  PUM  PE>-'AVI')P  n>-  THE  SYSTEM  IS  FDUMO  FJR  EACH  pQSS- 
1  ;)  L  E  c  P  1  I  1  A  ,  V  A  L  J  E  P  C  P  .  I 
NI2  ••  -  1  : 

r  j H  p r.  2  o .  1  c  s  T  ^  0 .  r  s  j  -i t  1 p c  R 1  t  on  h e s  I  n 
FjR  i*-osnp  TA-i!,_c  :'srn<prp  on  ^4-1; 

M  V  2  *  1 ;  <  2  •-  M ;  A  .1  s  s  A  (  u  L  ♦  1 »  N 1  -t  1 ,  M  2  ♦  1 » A  A ,  9  a ,  X  4  s  I  sj  r, )  ; 
vii*-M3*-P34-a.c;  p:ip  i^-ostep  iu^til  m  od  besin 
Mi*-Mi+rscnxxLn;  MD^-Mo^fi-rscnixxtn; 

IF  TS1CI12PCR  Them  Pn-  =  n  +  x c  1  ]  xtsp u  iixT si  [ n  ; 

IF  ts?ci]=apcr  them  Po*-Ro  +  xt  nxjsppc  n*Ts?t  n;  emoj 

xo*-(moxpov«41xpi  )/(mo  +  mi  ) ; 

BEGIN  FDHMAT  tmTK  X7,  EA.2,  X3,  Fe.2.  FV,2,  F8,2,  X2»  F 7 . A , X 3 , 2 ( F 8 , 3  ) 
FIO.SUlIST  3jTl(PCR»Mn*Ml.M0»Ml,i-X0xl-R0»R0»l/(M0*Ml)); 

HRi TECFMi i«DjTi  );emo;  end; 

wHITECCPAGEI)!  GD  TO  START;  END! 

SINGI  BEGIN  FDRHaT  Fi''SINGiJlaR  MATRIX");  W  R  I  T  E  C  F  )  )  E  N  D  x  G3  TO  START) 

END  , 
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